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Abstract 

Information does not generally behave like a flow in communication networks with multiple sources and 
sinks. However, it is often conceptually and practically useful to be able to associate separate data streams with 
each source-sink pair, with only routing and no coding performed at the network nodes. This raises the question of 
whether there is a nontrivial class of network topologies for which achievability is always equivalent to "routability", 
for any combination of source signals and positive channel capacities. This paper considers possibly cyclic, directed, 
errorless networks with n source-sink pairs, mutually independent source signals, and a relaxed communication 
objective in terms of demanded information rates at sinks. The concept of triangularizability is introduced and it is 
shown that, if the network topology is triangularizable, then a given combination of source signals, demand rates 
and channel capacities is achievable if and only if the digraph supports a feasible multicommodity flow. 

I. Introduction 

In an n-pairs communication network, n source signals must be conveyed to their corresponding sinks 
without exceeding any channel capacities. Until quite recently, the belief was that this was possible iff there 
existed a routing solution, i.e. if every bit generated by a source could be carried without modification, over 
channels and through network nodes, until it reached the sink. At a macroscopic level, this is equivalent 
to presuming the existence of a feasible multicommodity flow JT). 

However, in 0, 0, an example was constructed of a multi-source, multi-sink communication network 
that did not admit a routing solution, but became admissible if nodes could perform modulo-2 arithmetic 
on incoming bits. This counter-intuitive result started the field of network coding, in which nodes are 
permitted to not just route incoming bits, but also to perform functions on them so as to better exploit 
the network structure and the available channel capacities. 

It is now known that the achievable capacity regions of networks with multiple sources and sinks are not 
generally given by feasible multicommodity flows, although in Q, the capacity region of a special class 
of 3-layered, acyclic rc-pairs networks was demonstrated to be given by multicommodity flows. In 
n-pair networks were constructed with coding capacity much larger than the routing capacity. Other related 
work includes [6], in which a necessary and sufficient condition for broadcasting correlated sources over 
erroneous channels was found, and 0, in which linear network coding was shown to achieve capacity 
for a multicast network. 

Notwithstanding the power of network codes, routing/multicommodity flow solutions are appealing 
in several respects. Most obviously they are simpler, because network nodes are not required to perform 
extra mathematical operations on arriving bits. In addition, because different data streams are not "hashed" 
together by means of some function, there is arguably less potential for cross-talk between different source- 
sink pairs, arising for instance from nonidealities during implementation in the physical layer. Furthermore, 
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Proc. IEEE Int. Symp. Information Theory, St. Petersburg, Russia, August 201 1, under the title "When is rc-pairs information a multicommodity 
flow?". 
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being able to treat information as a conservative fluid-flow could potentially provide a simple basis to 
analyze communication requirements in areas outside traditional multiterminal information theory, e.g. 
networked feedback control and multi-agent coordination/consensus problems - see, e.g. (8]|, BUl. 

These considerations raise the natural questions of whether there is a general class of network topologies 
on which achievability is always equivalent to the existence of a feasible multicommodity flow, and of how 
to characterise this class. This paper derives a partial answer to this question for possibly cyclic, directed, 
errorless networks with n source- sink pairs and mutually independent source signals. The communication 
objective is relaxed so that, instead of reconstructing the source signals with negligible probability of 
error at the sinks, the aim is for the marginal information rate supplied to each sink to exceed a specified 
positive demand. 

The structural concept of triangularizability is introduced, and the main result (Thm. [TJ) is that if the 
network topology is triangularizable then the network is structurally mutable, i.e. a given combination 
of source signals, demand rates and channel capacities is achievable iff the network supports a feasible 
multicommodity flow. This property inheres solely in the topology of the network and suits situations 
where channels, switches, transceivers and interfaces are expensive to set up and difficult to move, or 
where channel capacities, output demands and source-signal statistics are unknown. 

The primary significance of this result is structural, not computational. Algorithms can be devised to 
check whether or not a given network topology is triangularizable, by working directly from the definition. 
However, the explicit construction of such procedures and the analysis of their computational complexity 
will be addressed elsewhere. 

Note that although triangularizability is sufficient to guarantee that routing can always achieve the full 
capacity of a network, it is not necessary, and the question of finding a structural condition that is less 
conservative - or even tight - remains open. Further work is also needed to clarify the connections with 
existing results on degree-2, 3-layered acyclic networks in [4] and the directed cycle networks of [TfOll . 

A. Notation and Basic Terminology 

For convenience, the basic notation and terminology used in this paper are described below. 

• The set of nonnegative integers (i.e. whole numbers) is denoted W. 

• A contiguous set {i, i + 1, . . . , j} of integers is denoted [i : j]. 

• Random variables (rv's) are written in upper case and their realizations are indicated in corresponding 
lower case. 

• Sets are written in boldface, apart from common ones such as R and W that are conventionally 
written in blackboard boldface. 

• The set operation A\B denotes AflB c . 

• A random signal or process (F(k))^ =0 is denoted F. With a mild abuse of notation, the finite sequence 
(F(k))[ =0 is denoted F(0:t), 

• Given a subscripted rv or signal Fj, with j belonging to a countable set J, Fj denotes an ordered 
tuple (Fj)j € j, arranged according to the order on J. 

• The entropy of a discrete- valued rv E is denoted H[F] > and the differential entropy of a continuous- 
valued rv F (with absolutely continuous distribution) is written h[F] E K. The conditional versions 
thereof are denoted H[F|-] and h[F|-] respectively. 

• The mutual information in rv's E and F is denoted I[F;F] > 0, which is defined as H[F] — H[F|F] 
if E is discrete-valued. If E is continuous-valued, H is replaced with the differential entropy h. 

• The conditional mutual information in rv's F,F given G is denoted I [£■ ; 1 C7] , which is defined as 
H[F|G] — H[F|F, G] if E is discrete-valued. If E is continuous-valued, H is replaced with h. 

• If F,F are random processes and E is discrete- valued, then the entropy rates of E, and the conditional 
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entropy rate of E given (past and present) F are respectively defined as 

H[£(0:Q] 
t+1 ' 
H[E(0:t)} 



Hco[£] 


:= lim 








:= lim 




Hoo[E\F] 


:= lim 





t+1 1 

H[E(0:t)\F(0:t)] 
t+1 ' 

If E is continuous-valued, H is simply replaced with h. 

If E,F and G are random processes, then the mutual information rates of E and F, and the conditional 
mutual information rate of E and F given (past and present) G are respectively defined as 

l\E(0:t);F(0:t)} 

M£;F] := M mo ■■ ty.no -.t)] t 

t— >oo ? + 1 

M £;F| G ] := 0^(0 = 010(0 = 01, 

t— >oo ? + 1 

A directed graph (digraph) (V,A) consists of a set V of vertices, and a set A of arcs that each 

represent a directed link between a particular pair of vertices. 

The initial vertex of an arc is called its tail and the terminal vertex, its head. 

A walk in a digraph is an alternating sequence (0 = (Vi,0Ci, V2, OC2, . . . , CC^, V^+i), k > 0, of vertices and 
arcs, beginning and ending in vertices, s.t. each arc 0C/ connects the vertex V/ to V/ + i. Each vertex v ; - 
and arc CC/ in the sequence is said to be in the walk; with a minor abuse of notation, this is denoted 
vj e a>. 

A path is a walk that passes through no vertex more than once, including the initial one. 
An undirected path is an alternating sequence (0= (Vi,GCi,V2,0C2, • • • ,CCfc,V£+i), k > 0, of vertices and 
arcs, beginning and ending in vertices, s.t. no vertex is repeated and where each arc a; connects the 
vertex V/ to V/+i, or v z+ i to V/. 

A cycle is a walk in which the initial and final vertices are identical, but every other vertex occurs 
once. 

A subpath of a path (vi,0Ci,V2,0C2, • • • > a &> v fc+i) i s a segment (v/,(X/,V/ + i, . . . ,Vy) of it, where 1 < 
Z<7<*+1. ' 

A vertex v is said to be reachable from another vertex /j, denoted n -w v, if 3 a path leading from 
H to v. Equivalently, it is said that /j can reach v. The same terminology and notation apply, with 
analogous meaning, for pairs of arcs as well as mixed pairs of arcs and vertices. E.g. given an arc 
(3, fJL |3 means that there is a path from the vertex fx to the tail of p\ 

Similarly, a (vertex- or arc-)set W is said to be reachable from another set U, denoted U ~* W, if 
there is an element of W that is reachable from an element of U; equivalently, it is said that U can 
reach W. 

The notation OUT(U) (IN(U)) denotes the set of arcs that have tails (resp. heads) in a vertex-set 
U C V but heads (tails) e V \ U. If U is a singleton {//}, the braces are removed for notational 
compactness. 



II. Problem Formulation 

A multiterminal network of unidirectional, point-to-point channels may be modelled using a digraph 
(V, A), where the vertex-set V represents information sources, sinks, repeaters, routers etc., and the arc-set 
A indicates the directions of any channels between network nodes. As usual with digraphs, it is assumed 
that no arc leaves and enters the same vertex, and that at most one arc leads from the first to the second 
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element of any given ordered pair of vertices. In other words, every arc in A may be uniquely identified 
with a tuple (/z,v) £ V 2 , with p. ^ It is also assumed that the digraph is connected, i.e. there is an 
undirected path between any distinct pair of vertices. 

In an n-pairs information network, the locations of sources and sinks are respectively represented by 
disjoint sets S = {gi, . . . ,o„} and T = {x\,. . .,X n } of distinct vertices in V, with each source aiming 
to communicate to exactly one sink x,-. It is assumed that a,- X ( -. The set of source-sink pairs (o,-,x ; ), 
i £ [1 :n], is denoted P C S x T. Without loss of generality, it is assumed that every source (sink) has no 
in-coming (resp. out-going) arcs and exactly one out-going (in-coming) arc. ^\ The boundary d\ of the 
network is the set SUT of source and sink vertices, and its interior is intV := V\3V. 

Each channel in the network can transfer information errorlessly up to a maximum rate, as specified 
by a positive arc-capacity c a £ M>o- In some situations, it may be natural to assign infinite capacity 
to certain arcsj^] and the set of all such arcs is denoted C A. In particular, the arcs leaving sources 
are by convention assigned infinite capacity. The set of finite-capacity arcs is written Af = A\Aoo, with 
associated arc-capacity vector c := (c a ) ae A f G ^>o • The structure of the n-pairs information network is 
defined as the tuple E = (V, Af, Aoo,P). 

The communication signals in the channels are represented by a vector S = (S a )aeA of random processes 
called arc-signals, with S a : W — > W na taken to be discrete- valued Va £ Af. In particular, the arc- 
signals leaving sources and entering sinks respectively represent the exogeneous inputs and outputs of the 
information network. For convenience, the signal 5out(ct,-) leaving the i-th source o, £ S is denoted Xu 
and the signal SWt;) entering the i-th sink X; £ T is called Yi. It is assumed throughout this paper that the 
signals X\,Xi, . . . ,X n are mutually independent, though each may itself be a correlated process, and that 
the signals on finite-capacity arcs are discrete-valued. 

The arc-signal vector S is assumed to have the following property: 

Definition 1 (Setwise Causality and Signal Graphs): An arc-signal vector S is called setwise causal 
on a structure E = (V,Af,Aoo,P) if all arc-signals leaving any internal vertex-set U C intV are causally 
determined by those entering it. That is, VU C intV, 3 an operator g\j s.t. 

W(U) W = 8V MlN(U)(° : 0) > £ W. (1) 

The tuple (E, S) is then called a signal graph. 

Remarks: Setwise causality is a generalization of the fundamental concept of well-posedness in feed- 
back control theory. In acyclic digraphs (i.e. in which every walk is a path), it is equivalent to causality 
at every internal vertex. However, feedback signals may be present in cyclic digraphs, in which case 
vertex-wise causality would not suffice to guarantee that outgoing signals from an arbitrary vertex-set are 
uniquely and causally determined by incoming ones as required in ([T]). Stronger assumptions would be 
needed, e.g. a positive time-delay at every vertex. 

In an n-pairs network, information must be conveyed from each source o, £ S to its corresponding sink 
x, so as to achieve some goal, without exceeding any channel capacities. In this paper, the goal is to 
guarantee that the marginal information rates supplied to the sinks exceed specified demands. This leads 
to the following definition: 

Definition 2 {Achiev ability): Consider an n-pairs information network with structure E, source-signal 
vector X, arc-capacity vector c £ r!^q and demand vector d := (dj)" =l £ R> - The tu ple (E,X,c,J) is 
called achievable if 3 a setwise-causal (Def. [T]) arc-signal vector S s.t. 

Sout(o,-) = X u Vie[l:n], (2) 
MM] > di, V/e[l:n], (3) 

r[Sa,X} < c a , VCC£A f . (4) 

'Such digraphs are sometimes called simple. 

2 If a source or sink were actually connected to multiple nodes in the network, it would be represented in the digraph by an auxiliary 
vertex connected by an arc (of infinite capacity) with a multiply-connected vertex. 

3 For instance, when a single network node is represented as two "virtual" vertices connected by an arc of unbounded capacity. 
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Such an S is called a solution to the n-pairs information network problem (L,X,c,d). The demand vector 
d is then called achievable on (E,X,c); c is called achievable on (L,X,d); and (X,c, d) is called achievable 
on E. 

The closure of the set of achievable demand vectors d is called the demand region D C ]R" of (E,X,c). 



Remarks: The objective ([3]) is a relaxation of the usual aim of reconstructing the source signals reliably 
or within some specified distortion level. This allows the standard assumption that each source signal is 
stationary or i.i.d. to be dropped. Note that when Xj is discrete- valued, d\ = HoopQ] is necessary for reliable 
reconstruction at x ; . 

Also note, it is implicit in Def. [2] that the input-output operators g v at every internal vertex v may be 
freely designed to yield a solution S, as long as setwise causality (Def. [T]) is respected. 

As mentioned in the introduction, it was once thought that a network was achievable^] iff it admitted 
a routing solution. In the present context, this is equivalent to presuming the existence of an (X,c,d)- 

feasible multicommodity flow, i.e. of a nonnegative tuple / = C/aj)aeAje[i:n] e ^>o'\ of bit-rates on each 
arc associated with every source-sink pair, s.t. 

fa,j ^ c «> Va e A f (capacity bound); (5) 

fm(x-),j — dj, V/ 6 [1 : n] (satisfaction of demand), (6) 
/otjt(o;)j < H°o[Xj], Vj G [1 : n) (sufficiency of supply), (7) 

L f a J = E f<*J (conservation of flow), (8) 

aeIN(v) aeOUT(v) 

for any j G [1 : n] and v G V \ ({CJ/} U {x ; }). Via an explicit counter-example, the article [3| showed that 
this intuitive notion was incorrect, i.e. that although the existence of a feasible multicommodity flow is 
sufficient for achievability, it is not generally necessary. This laid the foundations for network coding, in 
which nodes are permitted to not just route incoming bits, but also to perform functions on them. 

Nonetheless, routing/multicommodity-flow solutions have certain virtues, as discussed in sec. [TJ This 
paper poses the question: is there a general class of n-pair information network structures E for which 
the achievability of (X,c,d) is equivalent to the existence of an (X,c,d) -feasible multicommodity flow / 
©-f])? 

Any n-pairs information network structure E can support (X,c, d) -feasible multicommodity flows if 
the arc-capacities and source entropy rates are sufficiently larger than the demands (and provided that 
each sink is reachable from its source). However, there are examples of structures on which an (X,c, d)- 
feasible multicommodity flow does not exist if arc-capacities are reduced or demands increased, even 
though (X,c,d) is still achievable (see sec. |v|). 

The aim of this paper is to isolate certain structural properties that ensure routability over all achievable 
combinations of (X,c,d). Such properties would inhere solely in E, suiting situations in which channels, 
switches, transceivers and interfaces are expensive to set up and difficult to move, and/or where channel 
capacities, output demands and source-signal statistics are variable or unknown. 



III. Main Result and Requisite Graph-Theoretic Concepts 

Before giving the (affirmative) answer to the question above, several graph-theoretic notions must be 
defined for an n-pairs information network with structure E= (V, Af, A^P). 

First, some largely familiar concepts are revisited. A path in an n-pairs information network that goes 
from a source o ; to its sink x, is called an i-path and the set of all /-paths is called an i-bundle. In other 
words, the /-bundle is the set of all acyclic paths via which information can be routed from o, to x,-. 

4 ignoring differences in the definition of achievability 
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Given a set J C [1 : n], the set of all /-paths with i G J is called a J -bundle (not the same as the set of 
all {a, : z G J} {x ; : i G J}-paths, which contains it). Let (V, A ! ) denote the subgraph formed by all the 
vertices and arcs in the /-bundle. A vertex-set U C V such that o ; G U and x,- ^ U is called an i-cut. 
The following notions are somewhat nonstandard. 

Definition 3 (J-Disjointness): Given a structure E, an arc-set B C A is called J -disjoint for an index 
set J C [1 : n] if each path in the J-bundle passes through at most one arc in B. 

Remarks: Every singleton {a} C A is automatically J-disjoint and every arc-set B C A is automatically 
0-disjoint. 

Definition 4 (Chokes, Wholeness and Triangularity): Given a structure E and vertex-sets W,Z C V, an 
arc-set B C A is called a W Z-choke if all paths from the vertex-set W to Z pass through B. 
Given a source index i G [1 : n], a a ( - ~> x ; -choke is also called an i-choke. 

An z-choke B is further described as downward-whole if all a 7 ~> x,-paths pass through it, V/ G [1 : i— 1] 

S.t. Gj ~> B. 

An arc-set B C A is called a [1 : i]-choke if it is a j'-choke, Vj G [1 : i). 

A [1 : i] -choke is called triangular if it is a downward- whole j'-choke, Vj G [1 : i). 



Remarks: Downward-whole z'-chokes are useful because they are "immune" to any information about 
X\, . . . ,Xj-i that may be transmitted to the sink X/ without having passed through them, and thus obey a 
version of the data-processing inequality (see Lemma|4]in the appendices). Their immunity arises because 
V/c G [1 : i— 1], either no -w Xj-walk passes through them, or all of them do. 

Note also that a (triangular) [1 : i] -choke is automatically a (triangular) [1 : i — 1] -choke. 

Definition 5 (Viable i-Cuts): Given an index i G [1 : n] and a structure E, an z'-cut U C V ! is called viable 
under the following conditions: 

1) Every arc in OUT(U)nA' is finite-capacity. 

2) There is an z'-path that leaves U without re-entering. 

3) Each arc in OUT(U) flA' lies in an z'-path that exits U without re-entering or that lies in the [1 : i— 1]- 
bundle. 

4) Every vertex v G U lies on an undirected path n from a ; to v such that 

a) all vertices before v on n are in U, and 

b) every reverse- oriented arc in n (i.e. pointing from v to G;) lies on an z'-path that does not re-enter 
U. 



Remark: These are the structural properties of min-cuts in a residual capacitated digraph that is used in 
appendix [C] to prove the main result. 

Definition 6 (Reverse Structure): Given a structure E, the reverse structure If := (V,A(-, A^,P') is given 

by 

A^ := {a/,vO : (vV)GA f }, (9) 
AL := {0/y):(vV)eA-}, (10) 

p' : = {(o;,x;):(x;,o;)gp}. o od 

Remarks: This describes the w-pairs information network obtained by reversing arcs and swapping the 
roles of sources and sinks. The reverse structure is useful because a multicommodity flow on E can be 
reversed in direction to yield one on E' and vice- vers a. 

Definition 7 (Triangularizability): A structure E is called triangularizable if there is an ordering (ai, 8i), 
. . . , (o n , 8 M ) of the source-sink pairs so that Vz G [2 : n] and every viable z'-cut U (Def. [5]), a [1 : i — l]-disjoint, 
triangular [1 : z']-choke is contained in OUT(U) D A'. (Def. H). 
Remark: Triangularizability is not generally invariant under reversals of structure. 
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The main result of this paper can now be stated: 

Theorem 1 (Triangularizability Implies Structural Routability): Suppose an n-pairs information network 
has a structure E or reverse structure E ; (Def. 6} that is triangularizable (Def. Then E is structurally 
routable, i.e. (E,X,c,J) is achievable (Def. |2) iff an (X,c, d) -feasible multicommodity flow / ([5])-([8]) 
exists on E. y 

The proof of this result is given in the appendices, but for convenience its central ideas are described 
in the next section. In sec. |V} two network examples are discussed to illustrate Thm. [T] 

IV. Key Elements in the Proof of Thm. Q] 

Throughout this section, E = (V,Af,A«>,P) is the structure of an n-pairs information network, as 
described in sec. In both the proofs of necessity and sufficiency, use will be made of the fact that 
Vz G [1 : n], any single-commodity flow q from a ; to x ; in the structure E can be decomposed into a 
superposition of i-path flows and cycle flows (see e.g. IfTTTl . Thm. 3.3.1). That is, if Tty, ...,n Pi j are the 
distinct z'-paths and j\, . . . ,y g , the distinct cycles, then 3 numbers wy, . . . ,u p j > and w\^ . . -,w g j > 
s.t. 

qa= U k,i+ Y w hi- ( 12 ) 

i<k<pi-.Tt kJ 3a l<l<g:y t 3a 

If Wn = for all / G [1 : g), then q is called acyclic. 

The proof of sufficiency in app. |d] is relatively straightforward. If / is an (X,c, d) -feasible multicom- 
modity flow (|5])-([8]) on E, the decomposition ( [12] ) is used directly to devise a routing solution S. 

The proof of necessity in app. |C]is more difficult and involves induction, using the following building 
blocks. 

Definition 8 (J -Flow): Given an index set J C [1 ;n], a nonnegative tuple /= (/a j) aeA jeJ £ M^d'^' is 
called a J -flow on the structure E if V j e J and v G V \ {oj} U {x ; }, 

Y f a J = H f<*J O'" flow conservation), (13) 

ocelN(v) oceOUT(v) 

As a convention, the 0-flow is defined as the empty sequence (). 

Remark: A J-flow is a (possibly infeasible) multicommmodity flow with source-sink pairs (<3j,Xj), j G J. 
If each /'-flow f\ j is acyclic, V j G J, then / is called an acyclic J-flow. 

The next concept is central to the proof of necessity. It defines a class of feasible [1 : z]-flows that obey 
certain information-theoretic bounds when only the signals Xj, j G [1 : i] need to be communicated. 

Definition 9 (Informational Feasibility): Given i G [1 : n] and a setwise-causal arc-signal vector S (Def. 

1 ), a [1 : z']-flow / G M^g (Def. 8) is called informationally feasible on the signal graph (E,S) if it satisfies 
the following conditions: 

i) On every arc a G Af , 

£/,-,« <c a . (14) 

7=1 

ii) On any [1 : z']-disjoint, triangular [1 : z']-choke B (Defs. [3]&[4]), 

Y faj - Io ° [^[luf^Bl^i+lin]] ■ (15) 
aeB, je[l:i] 

iii) On arcs entering sinks and leaving sources, 

fm(Xj)J = fom(Gj),j = !°° > v i e t 1 : z 1- ( 16 ) 





Remarks: Intuitively, (15) is restricted to [1 : z']-disjoint sets because the flow contribution corresponding 



to a path in the [1 : i] -bundle could otherwise be counted more than once. Note as well that the 0-flow is 
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Fig. 1. Butterfly Network 



informationally feasible, since the condition (16) disappears and the inequality (15) has a zero left-hand 
side (LHS) and so is trivially satisfied. 

The following result concerning informationally feasible [1 : n] -flows also plays a key role. 

Lemma 1: If the arc-signal vector S is a solution to the n-pairs information network problem (E,X,c,<i) 

(Def. 2), then any informationally feasible (Def. 9) [1 : n]-flow / G W>i n on (E,S) is an (X,c, d) -feasible 
multicommodity flow on E <|5j) — <|8]>. V 
Proof: See appendix [Bj 

The proof of necessity in appendix [C] uses upward induction to construct a sequence of informationally 
feasible [1 : /] -flows (Def. [8|, i £ [1 : n]. By Lemma [TJ /" is then an (X,c, d) -feasible multicommodity 
flow, as desired. 



V. Examples 

The first example, a 2-pairs butterfly network, is adapted from J2]|, lfT2l and depicted in Fig. [T] All 
its arcs have infinite capacities except on the arc from ©i to ©2. The signals X\ and X2 are i.i.d. and 
binary-valued with H[Xi (?)] = Hp^ff)] = 1, and the demands d\ = d 2 = 1. 

The vertex-set U = {o2,Vi,CQi} C V2 = {a2,Vi,©i, ©2,^25X2} is a 2-cut. Observe that 

1) OUT(U) HA 2 = {(©1,(02)} is finite-capacity, 

2) the 2-path (02, Vi,©i, ©2,^2,12) leaves U without returning, 

3) OUT(U) flA 2 = {(©i,©2)} lies in this non-returning 2-path, and 

4) every vertex e U lies in an undirected path from 02 such that all its predecessors in the path are also 
in U, with no reverse- oriented arcs. 

Consequently U is a viable 2-cut (Def. [5]). However, OUT(U) fl A 2 = {(©i,©2)} does not contain any 
triangular [1 : 2]-choke (Def. [4b, since one o~i ~» X2-path, (01,^1,^2,^2), bypasses it but the other, 
(oi,//i,©i,©2,^2,X2), does not. Consequently, this network is not triangularizable (Def. [7]) and Thm. [T] 
does not apply. 

This is in agreement with [fT2|. Observe that if if c = = 2, then (X,c,d) is achievable by routing, 

since 1 unit of flow can be routed from Gi to Xi and from 02 to X2 via (©i,©2), without exceeding its 
arc-capacity. However, if c is reduced to 1, then the network can no longer support an (X, c, d) -feasible 
2-commodity flow (|5])-([8]). Nonetheless, (X,c,d) still remains achievable, by sending the signal X\ on 
(m,H2),X2 on (Vi,v"2j, andZ = Xi+X 2 (mod 2) on (©i,© 2 ), (©2,^2) and (©2,V2), and setting Y 2 =Z+X\ 
(mod 2) =X 2 and Y\ =Z + X 2 (mod 2)=X h 

Next, consider the cyclic 2-pairs network of Fig. [2] The only 2-cuts \J k with OUT(U fc ) fl A 2 C Af are 
U 1 = {o2,//i,©}, U 2 = {O2,^i,(0,vi} and U 3 = {02,^1, ©,Vi,V2}. For the first two 2-cuts, 

OUT(U^) n A 2 = {(© 5i u 2 ), Gui,v 2 )} , k= 1,2, 

while OUT(U 3 ) n A 2 = {(©,^2)}- Observe that 

• There is a 2-path, n = (o 2 ,/Ji,(i),iJ 2l x 2 ), that leaves each U k without re-entering. 

• The single arc (©,^2) in OUT(U 3 ) fl A 2 lies in the non-returning 2-path n. The other arc O u i,V 2 ) in 
OUT(U fc ) flA 2 , k = 1,2, does not lie on a non-returning 2-path, but does lie on a 1-path. 

• Every vertex in U 1 lies in an undirected path from o 2 that does not leave U 1 and does not contain 
any backward-oriented arcs; the same for U 3 . 
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Fig. 2. Cyclic Network 

• Every vertex v in U 2 lies in one undirected path from 02 that does not leave U 2 . However, when 
v = Vi, this path contains a backward arc (vi,(o) that does not lie on a non-returning 2-path. 
Consequently, the only viable 2-cuts (Def. [5| are U 1 and U 3 . 

Now, each arc-set OUT(U fc ) fl A 2 , k = 1,3, contains an arc-set B = {(co,^)}, which being a singleton 
is automatically 1 -disjoint. Furthermore, both 2-paths and the only 1-path pass through it, as does the 
only Oi -~> X2-path. Thus B is a 1-disjoint, triangular [1 : 2]-choke, and so the network is triangularizable 
(Def. [7]). Consequently, by Thm. [T] any tuple (X,c,d) is achievable iff there exists an (X,c, d) -feasible 
multicommodity flow. After eliminating the flow variables, (X,c,d) is thus achievable iff 

d\+d\ < Ca),^ , 

d\ < min{Hoo[Xi],c W)V2 }, 
d 2 < H»[X 2 ]. 



VI. Conclusion 

This paper examined the routability of possibly cyclic rc-pairs information networks from a structural 
perspective. The concept of triangularizability was introduced, and it was shown that for networks with 
triangularizable structures, routability and achievability are equivalent, i.e. a given combination of source 
signals, demand rates and channel capacities is achievable iff the network supports a feasible multicom- 
modity flow. 

Triangularizability is a conservative structural condition, and future work will focus on trying to relax 
it. The inductive nature of the proof of necessity in this paper requires it directly, so such a relaxation 
may entail a very different analysis. As a first step, more work must be done to clarify any connections to 
to the examples in the literature 0, iTTOll of special network structures for which routing always achieves 
capacity. 
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Appendix A 
Some Technical Lemmas 

Throughout this sub-subsection, E = (V,Af,Aoo,P) is the structure of an rc-pairs information network 
and r = (£,S), its signal graph, as described in sec. |n| and Def . [T] 

The following lemmas are intuitive, though some care is required in the proofs to construct suitable 
internal vertex-sets for applying setwise causality (Def. [TJ. 

Lemma 2: In the signal graph T, the arc-signal S a on any arc a G A is causally determined by the 
source-signal vector Xk, where K C [1 : n] is the index-set of all sources that can reach a. y 
Proof: Let U C intV be the set of all internal vertices that can reach a. Observe that the unique tail /u G V 
of any |3 G IN(U) can automatically reach a and thus would be G U if it were internal. However, as /u 
is outside U, by definition of IN(U), it must therefore be a boundary vertex and specifically a source o ; 
with i G K. As a G OUT(U), the proof then follows from setwise causality (Defn. [j]). □ 

Lemma 3: Let B C A be a {Oj : j G J} ~> x,-choke (Def. |4j) in the signal graph T, where J C [1 : «]. 
Then the arc-signal F, entering the sink x,- is causally determined by the arc-signal vector Sb on the choke 
and the source-signal vector Xjc, where J c = [1 : n] \ J. y 

Proof: Define Sj := {<5j : j G J} and Sjc := {oj : j G J c }, and let 7ti, . . . ,71/ be the different paths from Sj 
to x,-, each of which must pass through B. Let y^ be the last arc G B on 71^; Pk, the subpath along from 
the head of y^ to x ; ; and Vyt, the set of all vertices ^ x ; (therefore internal) on that are traversed after 
the arc y k . Define U := uJ. =1 V* and C:={y t : 1 <K/}CB. Let D := BniN(U) and E := B c niN(U). 

It is next shown that no arc r] G E is reachable from Sj. Let T) have tail v and head /j. Note that v ^ U 
and /j G U, by definition of IN(U). Plainly, /j must be the first vertex of a (possibly nonunique) path 
leading to x ; . In addition, /j has an incoming arc y# G D. Suppose that there were to be a path 71 from 
Sj to v. There would then be a path (tt, T[, p^) = 7l m from Sj to x,-, via the arc r\ ^ B. By definition, this 
path would have to pass through B at some stage, with the last arc of B it passes through denoted y m . As 
T| ^ B and p^ does not pass through B, it follows that y m lies on tt. Thus all non-x ; - vertices, including v 
that are after the arc J m on n m , would have to be in U, contradicting the fact that v ^ U. 

As the arc leading into x,- is an element of OUT(U), set- wise causality ([T]) implies that 

Yi(t) = S IN(T ,)(0 = g' v M D (0 : 0,Se(0 : 0) , V? G W. (17) 
As E is unreachable from Sj, Lemma [2] implies that 

S E (f)EEgi,foXjc(0:f)), V?GW, 

which substituted into ([17]) yields 

Yi{t) = g f 13 {t t S 1i ^--t) t gh(t t X F (0:t))) 

ee gG(t,S D (0:0,Xp(0:0), Vf G W. 

Observing that DCB completes the proof. □ 

Lemma 4: If B C A is a downward-whole /-choke (Def. [4]), then 

loo [X,-;17|X[ f+ i :n ]] < loo [X/;5b|X[ /+1: „]] . y 
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Proof: Let K be the set of all source indices j G [1 : n] such that Oj B, and define J := Kfl [1 : i] 
and J ; := [1 : i] \ J. From Def. |4| J 3 i and all {oj : j G J} ~^ x ; -paths pass through B. By Lemma [3] Yi is 
thus causally determined by 5b and Xjc = (Xji,Xu + i :n i), i.e. 

7,(0 :t)=g {t,S B (0 : t),Xj,(0 : t),X [i+1:n] (0 : 0) > V? G W, 

where g is a deterministic, time-varying mapping. Furthermore, by Lemma [2] 5b is causally determined 
by Xk, and hence by Xj and Xt i+ i :n \. So the argument Xj/(0 : t) in the RHS of the equation above must 
be independent of (5b (0 : t),Xu + i :n \(0 : f),X,-(0 : t)). From this, it follows that that 

Xi(0 : <-> (5 B (0 : t),X [i+1:n] (0 : 0) fc(0 : 0,*[;+i:»](0 : 0) 
forms a Markov chain. By the data processing inequality, 

I [Xi(0 : f);5 B (0 : 0l^+i:n](0 :t)] =1 [X,-(0 : t);5 B (0 : t),X [m:n] (0 : 0] 

> l[Xi(0:t);Yi(0:t),X [i+l:n] (0:t) 
= l[X ( -(0:0;^(0:0|X [i+1:n] (0:?) 



where the equalities are due to the mutual independence of the source signals. Dividing by t + 1 and 
taking inferior limits completes the proof. □ 



Appendix B 
Proof of LemmaQ] 

It will be shown that ([13]) with J = [1 : n], (fl4|)-(fl6|) with i = n, and Def. pimply <[5|)— @. First, observe 
that ([13]) with J = [1 : n] is identical to @, and (14) with z = n, to ([51. Next, note that ([16]) with z = « 
yields 



Ieo[Xj;Yj\Xy +l . n ]] 

H[Xj(0:t)\X y+hn] (0:t)] 



lim 

f^co I t + 1 

11^(0 :t)\Y J (0:t),X [j+l:n] (0:t 
t + 1 

]im H [X y (0 : 0] -H [X;(0 : f)l*/(0 : 0,%+i:n](0 : 0] 



t+1 



(18) 



^ I [Xj(0 : t);Yj(0 : t),X u+lM] (0:t)] 

f— >oo t+1 

Ioo[Xy;Yy-,X|^ +1:B ]] > IoofXyjY,-] 

J y , Vj'G [1 :n], 



(19) 



yielding (|6]), where ( 18 ) follows from the mutual independence of Xi, . . . ,X M . (If Xy is continuous-valued 
then h replaces H.) 
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Finally, if Xj is continuous-valued then H[X/(0 : t)] = °°, V/ G W, so Hoo[X,-] = °° and <Jv]) automatically 
holds. On the other hand, if Xj is discrete- valued then 



/oUT(<J;),j 



(161 



H[Xj(0:t)\X y+l:n] (0:t 



lim 



U[Xj(0:t)\Yj(0:t),X u+l:n] (0:t 
t + l 

H [X y (0 : J)] -H [Xj(0 : OltyO : t) ,X [j+1:n] (0 : 0] 



< lim 

Hpf/(0:0, 



(20) 



where the bound in (20) is due to the nonnegativity of discrete entropy. □ 



Appendix C 
Necessity Proof for Theorem CD 

Let the arc-signal vector 5 be a solution (Def. [2]) to the n-pairs information network problem c, d). 
An informationally feasible [1 : n]-flow (Def. [9]) /" will be constructed, using upward induction. By Lemma 



[Tj f n will then an (X,c, d) -feasible multicommodity flow, as desired 



ci-l 



(/«>;) aeA./ e ri:,--il eR >o l l) is an informa- 



Let E be triangularizable (Def. 7b and suppose that f — yja,jj aeA ^n.^] 
tionally feasible, acyclic [1 ;i — ljlflow for some i G [1 : n], noting that the 0-flow /° is informationally 
feasible. An /-flow (fa,i) ae \ G IR^q will be constructed in such a way that /' G K>q will be an informa- 
tionally feasible, acyclic [1 : /]-flow. 
On any arc a G A, let 

'•</. I; if aeAf 
oo if a G A^ = A\A f 



(14l 



fi-1 



be the residual capacity after subtracting the relevant components of / . Note that r a ^> since /' 
is an informationally feasible [1 : i — l]-flow. The next step is to find an acyclic /-flow (Def. 8) q G M^j 
from Gj X; that is a) < the residual capacity on each arc, and b) > 1^ [X,;y ; |X[ ;+1:;j ]] on the arc entering 
x,. There are two mutually exclusive cases to consider. 

A. 1st Case: 3 an i-Path with No Finite-Capacity Arcs 

Denote this /-path by n e , noting that r a = °°, Va G 7l e by the 2nd line of ( pi) . Set the /-path flows as 

loo [Z/;Fj|Z[ /+1:M ]] iffc = e 



V*e[l:/>], 



otherwise 
and the cycle flows equal to zero in the decomposition ( [12] ) (dropping the /-subscripts), so that 

III 



(22) 



£ VaGA. (23) 

l<fc<p:Jti3a 

Evidently q is acyclic and meets the residual capacity constraint on all arcs in A. Furthermore, since every 
/-path passes through the single arc entering x ; , 

jj23|) j 22 1 

<7lN(T;) — Uk Ue ~ Io ° [^^'Pfy+ltt]] ! (24) 

l<fc<p 

satisfying the conditional information constraint. 
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B. 2nd Case: Every i-Path Has One or More Finite-Capacity Arcs 
Observe first that for any arc-set B C Af, 



PeB peB 

y — H[5p(0:0]-H[5p(0:Q|X(0:f 

„ H \Sq(0 : 01 

= V lim — ^ J -± (25) 

PeB— '+ 1 

> beS*^ (26) 

H[5 B (0:0fc + i-nl(0:0] 

> lim n 1+ 1V ^ (27) 

H [5 B (0 : t)\X [i+1:n] (0 : 0] -H[S„(0 : t)\X(0 : 0] 
= lim [ — — (28) 

_ / H [5 B (0 : t)\X [i+l:n] (0 : Q] — H [5b (0 : t)\X [i:n] (0 : Q] 
f->-°° I f + 1 

H[5b(0:Q|X h (0 : 0] " H [5 B (0 : t) |X(0 : ?)] ' 



'l[5 B (0:f);X t -(0: 0|X [;+1:n] (0 : f 

\ ? + i 

l[5 B (0:0;^-i](0:OI^:»](0:? 



lim 



+ 



t + l 

> loo [X/jSEpfy+i^]] + I°° [Xflif-l] ; l^fcn]] • (29) 

In (25) and (28), the conditional discrete entropies are since, by Lem ma [2| 5b (0 : t) is a function of 
X(0TF); the inequality (26) is due to the subadditivity of joint entropy; and (27 ) holds because conditioning 
cannot increase entropy. 

Now, consider the residual capacitated digraph (V, A',r A ;) formed by the /-bundle |^] Let q be an acyclic 
maximal flow on it under the constraints 

0<q a <r a , Voce A*. (30) 



By the Min-Cut Max-Flow Theorem (see e.g. IfTTll . Thm. 3.5.3) 3 an /-cut U C V, consisting of every 
vertex vgV for which 3 an undirected path n in (V ! ,A ! ) from a, to V s.t. 

• (Forward Slack) every forward-oriented arc a in 71 (i.e. pointing from o ; to v) has q a < r a , and 

• (Backward Flow) every backward-oriented arc a in n (pointing from v to a,) has q a > 0. 
As a consequence of this, 

qa = r a , VcceO* :=OUT(U)nA\ (31) 
q a = 0, Voter :=IN(U)nA'. (32) 

5 Here, arcs are permitted to have r a = 0. 
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Note also that since the cyclic flow components w\,...,Wj in (fT2l are zero, 



qa 



£ u ki 

l<k<p:ltk3a 



Vcc G A''. 



(33) 



The /-cut U evidently depends on the residual capacity vector r. However, the following purely structural 
statements may be made about it: 

1) Every arc in O' lies in Af, i.e. is finite-capacity. Otherwise q a ® r a ® °°, implying by (33) that 
u k = 00 on some /-path 7t£, which is impossible since every /-path in this case travels over at least 
one finite-capacity arc. 

2) Every arc a G O' is in an /-path that exits U without re-entering, or else a is in the [1 : i — l]-bundle. 
To see this, suppose that ever y /-p ath 7U& passing through a re-enters U. Evidently, it must then pass 
through some arc |3 G I'. By (p2|) = 0, implying by virtue of (33) and nonnegativity that u^ = 0. 

ib, this implies that r a 



From (31) and (33 



0. As c a > 0, it mustthen hold that f a j > for some 
j G [1 : i— 1]. As the j-flow (f a ,j)aeA is acyclic by construction, a must then lie on a j-path, by 
<©.'"'' 

3) There must be an /-path that leaves U without re-entering. To see this, suppose in contradiction that 
every /-path re-enters U. By the preceding argument, all /-paths must then have associated acyclic 
flow components Uk = 0. Pick any /-path and let v be the last vertex in U that it traverses before 
leaving U without further re-entry. Let (O denote its subpath from v ~» By the definition of U, 
there is an undirected path n from a ; to v such that all forward-oriented arcs in it are slack and all 
backward-oriented arcs carry strictly positive g-flow. Note also that all vertices before v in 7C must 
also lie in U, by construction. From (33), any backward arc in n would have to carry an /-path 
flow component w& > 0, which would be a contradiction. Consequently, all the arcs in n must be 
forward-oriented, i.e. n is a directed path in U from o, ~> v. The concatenation of n with (O then 
yields an /-path that leaves U exactly once, a contradiction. 

4) Finally, by construction of U, every vertex v in it must lie on an undirected path n from a, to v such 
that 

a) every vertex before v in n is also in U (since the subpath from a,; to v automatically satisfies the 
defining forward-slack and backward-flow properties), and 

b) every reverse-oriented arc in n lies on an /-path that does not re-enter U (since such arcs must by 
definition carry positive g-flow, and /-paths that re-enter U carry zero g-flow). 

In other words, U is a viable i-cut (Def. [5]). By triangularizability (Def. [7]), OUT(U) contains an arc-set 
B that is a [1 : / — l]-disjoint, triangular [1 : /]-choke. Using /-flow conservation, 



9lN(ti) 



PeOUT(U) 



aeIN(U) 



PeOUT(U) 



> 



(291 



> 




i-1 



loo [Zi;5B|X[ /+1:B ]] +Ioc [X[i : ;-i];SBiX[ i:n ]] - 2L fjfi 

peBje[i:i-i] 

loo [Xi;SBp£[/+l:n]] , 



(34) 



since the informationally feasible [1 : i — 1] flow f 1 satisfies ( 15 ) on B, which is automatically a [1 : i— 1]- 
disjoint, triangular [1 : i— l]-choke. As B is also automatically a downward- whole /-choke, applying Lemma 
|4] to the RHS of @ yields 

<?IN(X/) > I°° [^^Bl^+l:^]] > I- [^S^l^i+hn]] > (35) 

as desired. 
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C. Construction of f in Both Cases 
For both cases above, let 



loo [Xi\Yi \Xi i+ i :n \\ 
fa,i-= — " [ -qa = vq a , Va G A, 

<?IN(X;) 



(36) 



where v G (0, 1]. Clearly, f\j is still an acyclic z-flow since it just a scaled version of q. Furthermore, 

i-1 



fa,j - vqa+Y, f<*J q a + £ f a j < c a - 

7=1 ;=i ;'=i 



24 ,(351 



It is next verified that f =/ax[1u] satisfies the remaining conditions (15 )— { 16 ) for an informationally 
feasible [1 : /]-flow. Let E be any [1 : i] -disjoint, triangular [1 : i] -choke in zl Then 

f\eE,je[l:i] 



52 52 fad 



(361 



(33LJ23]) 



£ vq n + £ /tij 
iieE rieEje[i:i-i] 

r|£E \l<fc<p:7lit9Ti / T)GEjG[l:/-l] 



(37) 



The [1 : z']-disjointness of E implies that each z-path n p transits over at most one arc in E. Combined with 
the nonnegativity of the z-path flows ui,...,u p , this implies that 

L E uk) = 52 Uk \ L 1 

T|eE \l<k<p:iz k 3r) J l<k<p X^eE-.^en/c 

< Y m ^ = 4IN(t,)- (38) 
\<k<p 

Furthermore, E is automatically also a [1 : i— l]-disjoint, triangular [1 : i— l]-choke, so by the informational 
feasibility of f'~ l , 

52 f%j ^ Io ° ^[U-rj^ElX^]] . 
TieEj6[l:i-l] 

Substituting this and ((38]) into ([37]) then yields 

52 f%j - V( lm(%i) [ X [l:i-l]'>S'E.\ X [i:n]\ 
TieEje[l:i] 



(36l 



loo [Zi;7f|Z[ i+1:n ]] +Ioo [X^.^jSeI-X - ^] 

< loo [Zi;5E|^[i + i :n ]] +Ioo [^[lu-lj^El^im]] 

< !°o [^ - [l:/];5'E|-X'[i+l:n]] , 



(39) 
(40) 



where (|39jis due Lemma |4[ since E is automatically a downward- whole z'-choke. This confirms that f 
satisfies (15). As f 1 ^ 1 is an informationally feasible [1 : i— 1] flow, (16) is satisfied Vj G [1 : z — 1]. By 
flow conservation, 

foUT(a t ),i = fjN(%i),i 



(36l 



verifying (16) when j = i. Thus f is an informationally feasible [1 : z']-flow. 
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By upward induction, /" is an informationally feasible [1 : nj-flow. If the reverse structure E' is 
triangularizable, the induction goes through identically, but with (Aj,A^,P ; ) replacing (Af,A OT ,P). The 
informationally feasible [1 : n]-flow f' n obtained on E ; then yields an informationally feasible [1 : n]-flow 
/" on E, using f { ^ v)J = f[ v ^j, V(/i,v) G A and je[l:n). 

By Lemma [T] f is automatically an (Z,c, d) -feasible multicommodity flow, as desired. 



Appendix D 
Sufficiency Proof for Theorem Q] 

In this section, the sufficiency part of Thm. [T] is established. For reasons of space, only a sketch is 
provided. 

Suppose / is an (X,c, d) -feasible multicommodity flow (|5])-([8| on E. In the decomposition (12) for 
each z'-flow f\^, no cycle flow can enter any sink, since it has no departing arcs. Consequently, the cycle 
flows may be taken to be zero in (12) without violating (|5])-([8]), yielding 

fa,i= £ U Kh (41) 
l<k<Pi'-Xk,i3Ct 

where fty, . . . ,7ln (V - are the z'-paths and . . .,u Ph i > 0, the z'-path flows. 

As LfLi H fc,i HoopQ], Slepian- Wolf- style coding ideas can be used, at the vertex succeeding each 
source a,-, to causally produce p\ mutually independent data-streams Z( \, . . . ,Zj Pi from each source signal 
Xj, with the /c-th data-stream designed to have average bit-rate H°°[Z^] = Hoo[Z^] = u^j and routed along 
the z'-path 7I& On every arc a G A apart from the ones leaving sources, the arc-signal is then represented 
by a vector S a = (^',fe)i 6 ri- w i k€[l-p-]-n k ea w ^ tn mutuai ly independent components 6 The arc-signals leaving 
sources are set to the respective source signals to satisfy ([2]). It may be verifiea that S is setwise causal 
(Def. [T]), since every signal is routed along an acyclic path. In addition, Va G Af, 



< 



r[S a ;X) = H-pcJ=H-[(Z^) te[lM] ^ [1:w] ^ 30 j (42) 

E H°°[Z ; , fc ] (43) 

ie[l:n],ke[l:pi]:n kJ 3a 

E a *.« 
E f°--' 5 

i6[l:n] 

where the 1st equality in ( [42] ) holds because 5 a is causally determined by X by Lemma [2] and ( |43| ) is due 
to the subadditivity of entropy. Furthermore, 



(41 



loo [X ; -;5 IN ( T .)] = loo [XijZ^i, . . . ,Zi iPi ] 
Pi 

Hoc [Z 5 i, . . . ,Zi iPi ] = E Hoo[Zj. 



WJt 



(44) 



2^ - /lN(x,),i - «- 



/c=l 



where (44) is due to the fact that Z, i, . . . ,Zi Pi are causally determined by Xj, and are also mutually inde- 
pendent. Consequently, 5 is a solution to the n-pair information network problem (L,X,c,d), establishing 
achievability (Def. [2]). 



6 If an arc is not on any z'-path, then its arc-signal may be taken to by a constant. 



